arXiv:1509.06352v3 [math.PR] 6 Apr 2017 


Forward Backward Doubly Stochastic Differential 
Equations and the Optimal Filtering of Diffusion 

Processes * 

Feng Bao ^ Yanzhao Cao ^ Xiaoying Han ^ 


Abstract 

The connection between forward backward doubly stochastic differential equa¬ 
tions and the optimal filtering problem is established without using the Zakai’s 
equation. The solutions of forward backward doubly stochastic differential equa¬ 
tions are expressed in terms of conditional law of a partially observed Markov 
diffusion process. It then follows that the adjoint time-inverse forward backward 
doubly stochastic differential equations governs the evolution of the unnormalized 
Hltering density in the optimal Hltering problem. 

Keywords. Forward backward doubly stochastic differential equations, optimal 
filtering problem, Feynman-Kac formula, Ito’s formula, adjoint stochastic processes. 


1 Introduction 

The goal of this work is to study the state of a noise-perturbed dynamical system, [/(, 
given noisy observation on the dynamics, Vj. This suggests the optimal filtering problem 
of determining the conditional probability oiUt, given an observed path {n,:0<s<t}. 
The pioneer work of optimal filtering problems was considered by Kallianpur and 
Striebel m and Zakai [23] . In particular, the Kallianpur-Striebel formula provides 
a continuous time framework of the optimal filtering that considers the conditional 
probability density function (PDF) of the state as the solution of a nonlinear stochastic 
partial differential equation (SPDE); and the approach proposed by Zakai leads to a 
linear stochastic integro-differential parabolic equation, referred to as the Zakai’s equa¬ 
tion. Under strong regularity conditions it can be shown that the solution of the Zakai’s 
equation represents an unnormalized conditional density of the state process. Funda¬ 
mental research of the optimal filtering problem was also conducted by Kalman and 
Bucy Ellin], Kushner and Pardoux [HIIH], Shiryaev m and Stratonovich [52], among 
other extensive studies on discrete nonlinear filter solver (see [51171151 [TUI [TI] 1 . 

The advantage of solving the optimal filter problems with SPDEs such as the Zakai 
equation is that it provides the “exact” solution for the conditional density of Ut given 
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{^s}o<s<t- However, it has not been considered as an efficient method by the science 
and engineering community because of its slow convergence and high complexity. In¬ 
stead of dealing with SPDEs, the unnormalized density function can also be studied 
through a system of stochastic (ordinary) differential equations (SDEs). Such a system 
consists of two SDEs, one standard SDE and one backward doubly stochastic differ¬ 
ential equation (BDSDE), and is referred to as a system of forward backward doubly 
stochastic differential equations (FBDSDEs). The EBDSDE system was first studied 
by Pardoux and Peng in [^, where the equivalence between FBDSDEs and certain 
parabolic type SPDEs was established. Our recent work [miiii] indicates that solv¬ 
ing optimal filtering problems with EBDSDE systems can be far less costly than that 
with SPDEs and more accurate than both SPDEs and discrete filter methods such as 
particle filter methods. 

In this paper, we establish a direct link between the optimal filtering problem and 
a EBDSDE system. First we provide a EBDSDE version of Feynman-Kac formula 
for the optimal filter problem and obtain the adjoint of this system. To the best of 
our knowledge, similar results have been obtained before. As a consequence, we show 
this adjoint, which is a a time-inverse EBDSDE system, provides a solution for the 
unnormalized condition density of the optimal filter problem. 

The rest of this paper is organized as follows. In Section [5] we present the math¬ 
ematical formulation of the optimal filtering problem and provide a brief introduction 
of FBDSDEs. In Section [3] we establish the connection between the FBDSDEs and 
the unnormalized conditional density function. Some closing remarks will be given in 
Section S] 

2 Preliminaries 

In this section, we present the mathematical formulation of the optimal filtering problem 
and provide a brief introduction of FBDSDEs. 

Let (D, J^,P) be a probability space, and let T > 0 be fixed throughout the paper. Let 
{lTt}o<t<T and {Bt}o<t<T be two mutually independent standard Brownian motions 
defined on (D, J',P), with values in and M}, respectively. Denote by Af the class of 
P-null sets of For each tG [0,T] and any process rjt, let 


J'gt ■=<^{Vr—'ns '-s^r^ t}\/Af 
be the cr-field generated by {r]r — r]s}s<r<t and write 


2.1 The optimal filtering problem 

Consider the following stochastic differential system on the probability space (D, J^,P) 



( 2 . 1 ) 


where {C/t S t > 0} is the “state process” that describes the state of a dynamical 
system and {Vj sRCt >0} is the “measurement process” which is the noise perturbed 
observations of the state Ut- Given an initial state C/q with probability distribution po{u) 
independent of Wt and Bt, the goal of the optimal filtering problem is to obtain the 
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best estimate of (j){Ut) as the conditional expectation with respect to the measurement 
{K-}o<s<i, where is a given test function. 

Denote by := a{Vr : 0 < r < t} the cr-field generated by the measurement process 
from time 0 to t and denote by Ait the space of all Jy'^-measurable and square inte- 
grable random variables at time t. The optimal filtering problem can be formulated 
mathematically as to find the conditional expectation 

According to [121E] , the optimal filter is given by 


E[mW] 


/R-i 


(j){u)ptdu 


/R'i 


Ptdu 


( 2 . 2 ) 


where pt is the unnormalized filtering density. (1^ is the well known Kallianpur- 
Striebel formula. 


Define 


Ql := exp 


' 1 /■* 
h{Ur)dUr — - / \h{Ur)\^dr 
^ Js 


When s = 0 we denote as Qt in short. Let P be the probability measure induced on 
the space (D, such that 


dP 

dP 



Qt- 


(2.3) 


Then according to the Cameron-Martin theorem the probability measures P and P are 
equivalent when the Novikov condition is satisfied [5]. Moreover, it is straightforward 
to verify that (see [T7], Lemma 8.6.2) 


E[cl>{Ut)\Ar] 


E[^(D,)Qt|.F,^] 

^Qt\Ar] 


(2.4) 


where E denotes the expectation with respect to P. 


2.2 Forward backward doubly stochastic differential equations 

For each t G [0,T], define 

Then the collection {/'j: t € [0,T]} is neither increasing nor decreasing, and thus does 
not constitute a filtration m- For any positive integer nSN, denote by A4^(0,T;]R”) 
the set of R^-valued jointly measurable random processes {'0t: t G [0,T]} such that ift is 
Tt measurable for a.e. t€ [0,T] and satisfies 

E f \tpt\'^dt < oo. 

Jo 

Similarly, denote by 5^([0,T];]R”) the set of continuous R"-valued random processes 
{tft : t G [0,T]} such that ipt is At measurable for any t G [0,T] and satisfies 

E sup |'0tP<oo. 

0<t<T 
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We next provide a brief introduction of forward backward doubly stochastic differ¬ 
ential equations (FBDSDEs), summarized from |20) . 

Given r>0, and a system of forward backward doubly 

stochastic differential equations (FBDSDEs) can be formulated as 

dXt = b{Xt)dt + aiXt)dWt, T<t<T, 

-dYt = f{t,XuYt,Zt)dt + g{t,Xt,Yt,Zt)d^t-ZtdWt, T<t<T, 

Xr=X, YT = ipiXT), 


or, in the integral equation form, for any t£ 


Xt — x + 


biXs)ds + J^ a{X,)dW, 


(2.5) 


Y 


= (^(Xt)+/ f{s,X,,Ys,Z,)ds+ [ gis,Xs,Y„Zs)dlBs- [ Z^dW,. (2.6) 

Jt Jt Jt 


Notice that equation (12.51) is a standard forward SDE with a standard forward Ito inte¬ 
gral and equation (12.61) is a backward doubly stochastic differential equation (BDSDE) 
involving the backward ltd integral J-dB s (see [19] for details on the two types of 
integrals). 

Let the mappings /: [0,T] x x x and g: [0,T] x x x ^ 

Rfexi jointly measurable and for any {y,z) SR^ xR^^'^, 




g(v,y,^)€A4'(0,r;R'=><'). 


Denote by | • | the Euclidean norm of a vector and by ||yl|| := Y^Tr(^^*) the norm of 
a matrix A. The existence and uniqueness of solutions, moment estimates for the 
solutions, and the regularity of solutions to Equation (12.6p rely on one or more of the 
following assumptions. 


Assumption 2.1 / and g satisfy the Lipschitz condition: there exist constants c>0 
and 0 < c< 1 such that for any {t,x) £ [0,r] x R'^, yi,y 2 SR^ and zi,Z 2 SR^^^, 

\f{t,x,yi,zi)-f{t,x,y2,Z2)\'^ < c(|yi-?/ 2 p + |ki -2:2^), 

\\g{t,x,yi,zi)-g{t,x,y 2 ,Z 2 )\\'^ < c|yi-?/2p+ c||2i -22|P- 

Assumption 2.2 There exists c> 0 such that for all (t,x,y,z) £ [0,T] x R'^ x R^ x R^^^, 

99 *{t,x,y,z) < zz* + c{\\g{t,x,0,0)f + \yf)I. 

Assumption 2.3 For any (t,a;,y, 2 ) £ [0,T] x R'^ x R^ x R^^'^ andOGMf^'^ 

^{t,x,y,z)e9* (^^{t,x,y,z)^ <69*. 

The following results are due to Pardoux and Peng m- 
Proposition 2.4 Under Assumvtion \2. A the BDSDE (|2.6p admits a unique solution 
(F,Z)£52([0,T];R'=) X A42(0,T;R'=^‘^). 
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Proposition 2.5 Let Assumvtions \2. l\ o,nd \2.2\ hold, then the solution of the BDSDE 
(1^ satisfies 

E sup |Ytp<cx). 

0<t<T 

For any positive integer k, denote by the collection of functions with bounded 
partial derivatives of all orders less than or equal to k, and denote by Cp the collection of 
functions with partial derivatives of all orders less than or equal to k which grow at 
most like a polynomial function of a: as a: ^ oo. It is well known that given b € Cf 
and for each (t,x) € [0,T] x the SDE (I2.5|l has a unique strong 

solution, denoted as Xf’^. Consequently denote by the unique solution to 

the BDSDE 


Yt = <f{X^’^)+ [ f{s,X:’^,Ys,Z,)ds+ [ g{s,X:'^,Y,,Zs)dBs- [ Z^dW,. (2.7) 

Jt Jt Jt 


Proposition 2.6 Let (/7GCp(M‘^;R^'). Under Assumptions \2.1\ - \2.,'?l the random field 
:T€ [0,T],a:GR'^} admits a continuous version such that for any tG[0,T], 
is of class a.s.. 


The following regularity result can be obtained by using standard techniques of 
SDEs, FBSDEs and BDSDEs (see Proposition 1 in [3]) 

Lemma 2.7 In addition to the Assumvtion \2. 11 assume that f,gGCli,. Then the solu¬ 
tion {Yf’^,Zf’^) to the BDSDE (12.7|) satisfies 


E 


{Yf’^-Yf’^y <C{t-T), E {Zf’^-zyy^ <C{t-T), 0<T<t<T, 


where C is a positive constant independent of t and t. 


Note that with the convention above, the unique solution to the FBDSDE system 
p.5l) (j2.6l) can be written as {Xf’^,Yy’^,Zf’^). Denote 


dXl 

VXI' := * 


dYf 


dx 


dx 


^r^rx dZl 

VZT’ := ‘ 


dx 


Then {VYf’^,XZf’^) is the unique solution to variational form of the BDSDE ()2.6|) (see 


]) 


df. 


df, 


df, 


XYr = v^'ixyyvxy^ + / ^ VXJ-- + ^XYr + jf^VZ, 


dx 


dY 


dZ 


ds 


+ 


- f xzy-dWs. 


In addition, the random field {Zf’^ :tG [r,T],xGR‘^} has an a.s. continuous version 

zy'' = xYy^(yxf’y-^a{xyy, zy^=xYy^a{x). ( 2 . 8 ) 


The following Lemma follows directly from Lemma [2.71 and Proposition [221 

Lemma 2.8 Assume that bdCfi,, f g&Cfi, and ipdCfi,. Then there exists C>0 

such that 

E[{vYy’^-vYyyy<c{t-T), E[{vzf’^-vzyy^]<c{t-T), o<T<t<T. 
Moreover, 

E sup |VE/’“|^<oo. 

0<i<T 
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3 FBDSDEs and Optimal Filtering 

In this section, we establish the connection between the optimal filtering problem and 
a FBDSDE system. In particular, we will first prove a Feynman-Kac formula in the 
hltering context. Then we present the adjoint relationship between standard FBDSDEs 
and time-inverse FBDSDEs. In the end we will show that the solution of a time-inverse 
FBDSDE is the unnormalized filtering density sought in the optimal filtering problem. 
For simplicity of exposition, we only discuss the one dimensional case with d = l and 
1 = 1. The same method can also be applied to multi-dimensional cases with more 
complicated calculations. 


3.1 Feynman-Kac type formula for optimal filtering 

For tG[0,T] and consider the following FBDSDE system on the probability 

space (D,J^,P) 

' dXt = bt{Xt)dt + atdWt, T<t<T (SDE) 

< -dYt = -ZtdWt+(^h{Xt)Yt + ^^Zt'^dX^t, T<t<T (BDSDE) (3.9) 
Xr=x, Yt = 4>{Xt), 

where a‘l = pl-\-pl, and b, p, p , h are the functions appeared in the optimal filtering 
problem m- Here Wt is the same Brownian motion as in the nonlinear filtering 
problem (EB, while Vt is the measurement process which becomes a standard Brownian 
motion independent of Wt under the induced probability measure P defined by (12.31) . 
Then Xt is a adaptive stochastic process and the pair {Yt,Zt) is adaptive to V 
TYt- For any single-variable function F = F(x), denote F' :=^ and F" = 


Lemma 3.1 Assume that bt and at are bounded and /i€C^(R;R). Then for any 0< 
s<t<T, there exists a positive constant C independent of s and t such that 

E[{h{Xt) - h{XYY\J^^T] < Cit - s). (3.10) 

Proof. The application of Ito’s formula to h{Xt) results in 

h{Xt) = h{X,)+ {br{Xr)h'{Xr) + ^h''{Xr'^dr + arh'{Xr)dWr, 

and hence 

{h{Xt)-h{Xs)f=(J (briXr)h\Xr) + Yf^"iXr)]dr +J arhfXYdWr') .(3.11) 


Taking expectation E of the above gives 


E[{h{Xt)-h{Xs)Y]=^ 


{br{Xr)h'(Xr) + ^h"{Xr))dry 


+ E 


{arh'{Xr)Ydr 


The inequality ()3.10|1 then follows immediately from the assumptions of the lemma. □ 
With ProDOsition l2.5l and Lemmas 12.71 and l3.11 we establish the following Feynman- 
Kac formula in the optimal filtering context. 
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Theorem 3.2 Assume that (j) bounded, and Then, VrS 

[0,r] and the following equality holds a.s. 

y;’“=E^[<^(c/T)Q^], (3.12) 

where [•] := E[- Ur = a:] ■ 

Proof. We prove the statement (13.121) for t = 0 only, the general case follows from 
the T = 0 case trivially. First it is straightforward to verify that under assumptions 
in Theorem 13.21 all the assumptions of Proposition 12.51 and Lemmas 12.71 and 13.11 are 
fulfilled. Since and are functions of x, we write = Yr{x) and = Zr{x) 
in the sequel. 

Let 0 = to < < ^2 ■ ■ ■ < tiv = y be an equidistant temporal partition with t„+i —tn = 

T/N := At and define 




-Qtr.ytAUtJ]. 


It follows immediately that 


N-l 

E-[cf{UT)QT-Yo{x)]=Y,^n 

n—0 


Denote Pa, :=P(-|t/o =a:). To prove (13.12P it suffices to verify that 


n—0 

For each n>0, let Ut„ be the solution of the state for (EU) at time step t„ and 
consider the FBDSDEs system (13.91) on [tn,tn+i] with initial condition Ut„'. 


dXt = bt{Xt)dt + atdWt, 


-dYt = -ZtdWt + ( h{Xt)Yt + !^Zt 


Xt=Ut. 


- ) dl7, 


(3.13) 


From the definition of the state process Ut in (EB and the SDE Xt in (13.13L we have 
the relation between and ^t„+i: 


Ut. 


= Xt. 


PsdWs - 


as{Xs)dWs 


-L 


,{dVs-h{Us)ds)YBJf+^ 


where 


on+l_ 

Hx — 


bs{Us)ds- 


bs{Xs)ds. 


To simplify presentation, for any process tft we write ipt :=ift{Xt) throughout the 
rest of this proof. Let Pn+i = C^i„+i ~ Then from the above we have that 

77„+i= [ ^^\sdWs- [ "^'a,dVF,+ [ ps{dVs-h{Us)ds)+R^+^ (3.14) 

Jtr, Jt-n Jtrt 
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Applying the Taylor expansion to we have that 

+ l i^in + 1 ) ^n + 1 A ^n + 1 ' ^^ + 1 A * (^n+l) “t“ ^n+ 15 


(3.15) 


where ^n+i is the Taylor remainder such that Eg [(^„+i)^] < C'(At)^. Then for each 
n = 0,l,2,---,Ar-l, 


A„=Eg 


= E" 


Qt„+i^t„+i(CA„+i) +Qt„5^„+i QtrtYt„{Ut„) 


{Q ^n + l Qtr.)yt 

n 


+ES [qu {yt.+.-YtjUt^, 


(i) 


(ii) 


(3.16) 


+ Ei? 


1 


Qtn+l ( Yin^iVn+l ~i~ ' iVn+l) +^n+l 


(iii) 

We next estimate terms (i), (ii) and (iii) in (13.161) one by one. 

(i) Write ht = h{Ut) and ht = h{Xt), and apply Ito’s formula to Qt„ we obtain 

=ES / h,Q,dVsYt^^, 


E; 


(Q T1 


=e;( 


^^n + l 


KQAVsYu 


Utn 


+ ES 


^^n + 1 




(/is-/is)QsdWbt„+i 

(3.17) 


Applying Ito formula to function h yields 

hs—hs = h {Ut„) ( [ Pr<y^r+ f PrdVr— f tT^-dWr ) + C>(At), 


and consequently with :=h {Ut„) we have 

ptn-^-l 


E" 


=E" 


J {hs-hs)QsdVsYt^^^ 

/ tn + 1 

dw( / p.dW,- / a,dW, 


-i: 


+ Eg 

+ ES 


htJQs-Qtj(Yt^+i-ytAUtj) dVs(^J^ PrdWr-J^ ardW, 


^t„Qtn^n + l 


PrdVrdVg 


+ 0 


((At)i). 


(3.18) 

First noting that h^^Qt^Yt^{Ut^) dVs is independent of prdWr—J^ ardWr 
we have 


ES 


ht„Qt„Y,, 




tr, 

^n + l 


dW / p,dW,- / UrdW, 


I 


= 0 . 


Second, it’s straightforward to verify that 


E" 


h. (g, - g* J - Ft„ (C/t J / dyj / p,dW, - / a,dW, 




(3.19) 

((At)i). 

(3.20) 
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Putting (13.1911 and (13.201) in (13.1811 . it follows from the regularity condition of pr that 


E" 


{K-hs)QsAVsYt^ 


= E" 


ptn + l nS 


+ 0 


((At)i). 


Define 


i^n:=h^^Qt^Ytr,+iPtr, / / dK-dt4- 

Jtn Jtrt 


(3.21) 


Then by using the facts dDrdl4 = i - Vt„)^ - At) and 

is independent of \ — At) we have 


7V-1 N-1 


1 


£i(0,P,). (3.22) 

n—0 n—0 

In summary (13.171) gives the estimate of the term (i) in (I3.16|) as 


(i)=E^ 


hsQsdVsYt„ 


with J2n=o^oWn] ^0 in £^(D,Pa;) as A—>-oo. 

(ii) It follows directly from the FBDSDEs system (13.131) that term (ii) in (13.161) satisfies 


+ ESK] + o((A)i), (3.23) 


(ii)=ES 


Qt^J ZsdWs-Qt^J 


h,Ys + ^Z, 




s~r ) d K s 

CTs J 


= -n 


Qt„ 


hsYs+~—ZAdiV s 

0’s J 


(3.24) 


(iii) By splitting term (iii) in (13.161) and using the definition of 77„+i in (13.141) we obtain 

1 , 


(iii) = Eg [(3t„+id"t„+i’7n+i 

= Ei 


rES 


t„+iCn+l] 


in+l ptn+l 

( / PsdWs- CTsdWs 


+ Eg 


Qtr^Yt 


' f 

■n + 1 j 

Ju. 


PsdVs 


(iii-i) 


(iii-2) 


+ Eg 


(Qt„ + 1 Qtn)Yf 


PsdVs 


• 


r^Ti+i 

-Eg 

*3tn + l^t„ + l j 

Pshsds 


(iii-3) 


+ Eg 




in+1 


-2®S 

✓ 


+K[Qt Tl + l ?n+l] ■ 


(iii-4) 

We next estimate terms (iii-1) - (iii-5). 
Denote 


(iii-5) 


(3.25) 




t„,x 


by: 




dZl 


dx 


dx 


dx 


\x=Ut„ 
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Then term (iii-1) can be written as 


(3.26) 

By using the fact that = l + 0(At) and the following variational equation 

(see EDI) 




(^h^yXs+hsVY. + ^yz.^dPs- 

we deduce that (13.261) becomes 


(iii-l)=ES 
+ ES 
=E;f 


{K 

Qt„+iVn 




'tn 

P^n + l pin 


PsdWs- / (JsdW, 


PsdWs - / (TsdWs 


-0((At)^) 


Qt„ / '‘^\ZsdWs + Xt^ 


PsdWs - / (TsdWs 


-om) „ 


where At„ (^l>"sVAs + /isVys + ^VZs)(i1/s + (3t„^iVyt„ is independent 

of PsdWs — CTsdWs and hence gives 


ES 


PsdWs - / (TsdWs 


= 0 . 


As a consequence 


(iii-l)=ES 


= ES 


j-U+i ^ / j-t^+i rt^+i \-| , . 

Qt„y^ XZsdWs-i^J^ Ps<^Ws-J^ CTsdWsjJ+o((At) = j 




n'^ (Ps-crs)ds +C>(^(At)2y 


(3.27) 

Let C represent a generic constant while the context is clear. By the definition of 


it is straightforward to verify that 


(iii-4)=ES <C{At)Y 


(3.28) 


to|w 
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Applying Ito formula to Qt^ in term (iii-3) we obtain 


(iii-3)=ES 




rtn + l 


/■*" + ! _ 

j PsdIA 

1 

OH 

J Pshsds 


hsQsdVs / 


• 

- / rtn + l 

1 

OH 

J Pshsds 


< 


ES 


IJtn 


hsiQl,-Qu+^)dVs / 


+ 


E" 


Qtr,+iY^t„+i { / hsdVs I psdVs- f Pshsds 


<C{At)i. 


(3.29) 


By using the definition of Pn+i in (13.141) . we deduce that 

ytn+i 

n + l 


1 , 


(iii-5) = -Eg 


{pi + pl+(T'^,-2psas)ds 


= ES 


ft 

Qtr.Yti+iJ^ (crf-pscrs)ds +e>((At)i). 


As a simple corollary of the assertion (12.81) . we have Y’l^_^at^^^=VZt^^^+0{At) and 
thus 

pt-n + l 


(iii-5)=ES 


Qtn^ ^tn + 1 I (,^S Ps)ds 


+ o({At)iy (3.30) 


It then remains to estimate term (iii-2). Notice that due to equations (12.8|) and 
(13.11) we have Zs/cts = VFs(VAs)“^. Hence for any sG[tn,tn+i] it holds 




- * (y.'^YrVXr + hrVYr + ^VZr'^dPr-^ V ZrdWr + 0{At), 


and therefore 

rt 


f^ri + l J ^ y ^ , ftn + 1 , 

-QtJ !^Z,dVs = -Qt„Y,^^J p~sdVs 


tn + 1 ptn + l 


Qt„ J p. 

rt 


KYrVXr.+KVYr + —VZ, 




dKdl/., 


VZ^dHAdK + C>((At)i) . 


Since W and V are two independent Brownian motions, 


ES 


Qt 


VZrdWr 


rYLyy r'A v s 


dt^. 


= ES 


‘I "V. 

rt„ + l rtr, + l ^ ^ , 

/ Ps {VZr-XZtJdWrdVs 

Jtr, J S 


(3.31) 


^^(At)^. 
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As a result, 


(iii-2)=E5 

-E; 

= ES 


Qt 


^ZsdVs 


Qtn J Ps 


KYrVXr + hrVYr + —VZ, 


Gr J 




Qt 


-ZsdVs 


-E" 


n+1 rtn+1 


dt^T-dt^s 


+ 0 


((At)i) 


where A+„ = 


(3.32) 

tr.=Qt„Pt„+i + is independent of 

= 5 ((Vt„^i — Vt„)^ — At). By an argument similar to (13.221) . we 

obtain 


N-l 

E«s 

n=0 


a + l /*tn + l 


dVi.dt^s 


N—¥<X) 


0 in £^(fl,Pa,). 


(3.33) 


Collecting estimates (13.271) . (13.281) . (13.291) . (13.301) and (13.321) into (13.251) : then insert¬ 
ing (13.251) . (I3.23|) and (13.241) into (13.161) we finally obtain 


A„=ES 


hsZgd^s t'n 


+ o((At)i) 


(3.34) 


h,QsdV,Yt^^,-Qt„ j 

= Eg [a„] + Eg [/3„] + Eg [7„] + Eg + O ((At) t) , 

where {un} is defined as in f|3.2ip satisfying (|3.22p . and 

■— J' (^Qs^s Qtn^tri^Yf^^^(lVs-, 

/3n := ^ Qtr,{ht„+iYt^+i-hsYs^dVs, 

In ■■= (dt„ ■(l^t„+i 

The last steps are to show that X]^=rQ^®'o['^ra] “^0; 
I]^=o^lEg[ 7 „] ^0 in £1(11,Pa;) as N^oo. 


First write a„ = an'^ + an'' + an'' with 

^ ''*\Qs-QtShsdVs-%^^,, 


ad) := 


ad) := 


a(3) .= 

'-*’n 


■= IJ^^QtSk- K )df4 • -Yt„)- 


Denote by E^, the expectation with respect to P^:, where Pa, :=P(-|[/o = a^) is the induced 
probability measure. Notice that =Yt„{Ut„) due to Xt„ =Ut„ given in (I3.13p . and 
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that ht is a bounded function, we apply Ito’s formula to (Qs — Qt„) in to get 

^-1 /•*„ + ! rS 




N-l 




n=0 


= E, 


< E, 


n—0 ‘ 


^^ /*in+i rs 

V / / 


n^QJtn Jt 


+ Ea; 


N-l 


^ ^Cn + 1 pS ^ 

Eg[E / / ~KQAVrhsdVs-Yt^^^] 

_n ^tr,. Jtn 

flj. (^Qj- Qtn )dl^/lsdV^ * ^tn + l 
KQt^dVrhsdVs 

^^71+1 

/V-1 _ 

E! QtA'tn + l ' n ((t^tra + 1 ~ —At) 


z*-® 

e/ 

rt=0 


< cEC^Oi+ce 


n=0 


n=0 


and from the fact that 

N-l 


E At) ^0 in 


n=0 


we have 


N-l 


n—0 

( 2 ) 

For a„ , we apply Ito’s formula to hs to get 
Eg[a),2)]=Eg[^ 


(3.35) 


=ES 


Since 6t, Ct, h' and h” are all bounded, we have 

^.[|Eg[a(2)]|]<CAt3/2. 

Moreover, it follows from Holder’s inequality. Lemma E771 and Lemma [XT] that 


^Tl+1 


^,[|Eg[a(f)]|]=S,yES[y^ Q,^{h,-htAdV,-{%^^,-%:)]\ 

<(E QtAA-htJdV.f]y • (e, -E)']) " 


<caN^. 


Hence, 


and 


N-l 


= EE§[a)f)]^0in 

n—0 

N-l 

EES[a)f)]^0in C\n,P,). 


(3.36) 


n=0 


(3.37) 
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Then, from (j3.35L (13.3611 and (I3.37L we get 


N-l 


^0 in C^{n,P^). 


n—0 


For the term /3„ in (I3.34|) . we have 


Pn=J^ Qt^ - t)) dVs 


f^n + 1 ^ ^ ^ ^ /*tn + l ^ ^ / 

= / Qtn(.dt„ + i—hs)Yt^dVs+ / Qtnhs{Ytn + l~Ys)dVs 

Jt„ Jt„ 

/ tn + l ^ ^ ^ ^ 

QtAht^^r-hs)dVs-{Yt^^,-YtJ 




with 




and 


/3i'^ = Qt^ - k)d'v. • - FiJ. 


(2) (3) 

Following the similar the approaches to ah and ah \ we have 


and 

Hence, 

and 


^,[|ES[/?(3)]|]<C'At3/2. 

1 

y]ES[/3W]^0in C\n,P,), 


N-l 


n—0 

N-l 


y]ES[/3(3)]^0in C\n,P,). 


n—0 


(3.38) 


(3.39) 

(3.40) 


From the BDSDE in p.9D , Lemma 12.71 Lemma 12.51 and estimate (13.311) , we get 


N-l 


N-l 


n—0 


y]ES[/3i^)]=y]E§ 

n—0 
N-l 

= E«s 


n=0 


Qt^h, 
Qtn ds ( 


ZrdWr — 


{hrYt^ 


{hrYr + ^Zr)d!V r')d^ S 

,)dK)rfK]+o((At)t) 


N-l 


n=0 


+ y]ES[/” QtX{ r hr{Yt„^,-Yr) + ^{Zt^^,-Zr)dVr)dV,] 
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Next, we take conditional expectation to the absolute value of the above equation. 
Since 

<C{Atf 

and 

^-1 rtr, 


E^, 


_/ p'^n + l ^ ntn-\-l 

0 L X] / Qt„^x{- / 

N-1 


hrYt^^,dVr)dVs]\ 


<CeJ\Y, Qt„ -Vty- At) I 


n—0 


it follows from the fact 

N-l 


n—O 


that 


Hence, 


E • 2 ((^‘n+x At) ^0 in £1(0,P,) 

N-l 


n—0 


N-l 


E§[E/3n]^0in Li(0,P,). 


n=0 


For 7 n, applying Ito formula to ht, it’s easy to verify that 

mht^^,-htj\<cAt. 

Since /it„ is independent from Qt„Yt„{Vt„^^ -Vt,,), 

es[ 7„] = Eg (/it„ - V+J • iVt^^,-Vt„)] 

+Eg [Qt„ {K+. -K)- {ht^ - ht^+0 ■ )] 

= Eg [ht^ - ■ Eg - Vt„ )] 

+ Eg [Qt„ - Ft„) • {ht^ - - Vt ^)]. 

Then, from estimate (I3.43F lemma ETTl lemma IXTl we get 
£x[|ES[7„]|] < CAt-E4\QtNt„-{Vt„^,-VtJ\] 

YEx \\Qtn (^n + l ~^tn) ■ (^tn ~ ^tn + 1 ) ' (rt„ + i ” Ft„)|] 

<C(At)i 

and therefore 

7V-1 

in L\^,Px)- 

n—0 

Finally with convergence results in (|3.38p . (|3.42p and (|3.45p . we have 

N-l 

^A„^0in P1(0,P,) 


n=0 


(3.41) 


(3.42) 


(3.43) 


(3.44) 


(3.45) 


as required. 


□ 
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3.2 Adjoint FBDSDEs 

In this subsection, we consider the following FBDSDEs system, in which the “forward 
SDE” (12.51) goes backward and the “Backward SDE” (12.61) goes forward 

(&t=bt(^t)dt — atd^t, 0<t<T (SDE) 

< = 0<t<T (BDSDE) 

^T=X, ^o=Po{^o), 

T f- T 

where 0 < r < T, -dlFs is a backward Ito Integral and -dEs is a standard forward 
Ito integral. Write the solution to (I3.46|) as Then by inverting 

the time index in the standard FBDSDEs system, is a adaptive stochastic 

process and the solution of the BDSDE in (13.461) is adaptive to Jy'j. V 

Similar to the notation used in Section 2.1, we denote ^tix) and t{x) . 

In addition, for any non-negative integer m and function rit{x) we write := 

We need the following regularity properties for b and a. 

Assumption 3.3 For Q<s<t<T, functions b and a satisfy 

|6t(a:)-&s(a:)|-f |&((a:)-6),(x)| <(71^-51, \crt-as\<C\t-s\, 

where C is a given positive constant independent ofb, a, s and t. 

Lemma [33 can be proved by using repeatedly the variational form of BDSDEs [20] . 

Lemma 3.4 Assume that hGCfi^ and every derivative ofb, (j) and h 

has bounded support in R. Then for each mi =0,1,2 and m 2 = 0,1,2,3, 
have bounded support and satisfy 


[ E 

sup 

vi^i) 

2 

dx < cx) and / E 

sup 


2' 

dx < 00 . 

(3.47) 

jR 

.0<i<T 



Jr 

.0<i<T 






Denote by (•,•) the standard inner product in The following theorem shows that 
t is the adjoint stochastic process of Yt defined in the FBDSDEs system (13.9F 

Theorem 3.5 Assume that, in addition to Assumption \3.3h olds. a is uniformly 
bounded, b^Cf^, (j)€Cff,, hGCfi, and each derivative ofb, (j) and h has bounded support 

in R. Then the process Rt '■= ^Yt,^ t), tG [0,T] is a constant for almost all trajectories. 


Proof. According to [20], Rt has a.s. continuous paths, it suffices to show that Vs,tG 
[0,T], Rs = Rt a.s.. 

For 0<s<t<Tlet s = tQ<ti<---<tj^ = t be a temporal partition with uniform 
stepsize —tn = = At. For simplification of notations, we denote 


:=E_.-E. 






Zn ■— Zt„, 
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By Corollary 2.2 in [20], we have 

Denote conditional expectations 

E[.]:=E[.|J-^], E2[-]:=E[-\T¥,Xt^=x], t”[-] :=E[.|=x]. 
It then follows from the definitions of E" and that 

e:[y^]=y4x), 

Without loss of generality suppose that At < s A (T — t) and define 


pt+At 




Yj-Ar, 




At 


dr. 


s — At 


For n = 0,1,...,A—1, taking the conditional expectations E” and E"+^ of temporal 
discretized approximations of the BDSDEs in (13.91) and (13.461) . respectively, we have 
that (see |3|) 


E^ [K] = E- [r„+i] +ES [hn+iY^+i] AVt^ +E^ 






n+1 


ADt„, (3.48) 




At 


+t"+i AI4 -t"+i 


Ptn -A 
Zj ri 


AW 


(3.49) 


where 


h-n+ih(At„^i), 6 (j:—&(^(^t„), hn:—h{Xt^). 

By the definition of expectations E" and E"+^, 


ES[W+i]=E ti(A‘:fJ 




= E 




tn + 1, 
tn 




= E 


[h^ 


tn + 1, 
tn 


Multiplying (13.491) by E^ and (I3.49P by E"+^[y„+i], then taking integral with 
respect to dx, we obtain 


E- [Yr,]M:[fn])=(K [An+l] , + (e^ [h 


n+l^^+l] 5 




+ (]E: 


Pt„ 




in+l 




(3.50) 


+ (^^1 \tSu] ,ErM^n+l])AW-(fe 


,E^M>^n+l])At 


Pin 

Zj 

^tn 


,ErM^n+l])AW- 


(3.51) 


and 


































Bao, Cao <fe Han 


18 


Subtraction of (13.5111 from (13.5011 results in 


= (e^ [y„+i] + (tr'[?n],E- [r„+i] -E^i [y„+i]) 


'- V - 

(iv) 

+ (e- [hn+lY„+,]M:['^n])AVt„ - (fes+l 

w ^ 

n ^ n 

,ErMy»+i])AE*„ 

+ (e” 

Ptn + l ry 

■^n+1 

(v) 

pt„ 

^ n 
l^tr^ \ 

,Er'rn+i])Ayt„ 


(vi) 




(3.52) 

In what follows, we prove that by taking the sum of equation (13.5211 from n = 0 to 
n = iV—1, the right hand side of the resulting equation converges to 0 as At—>-0. To 
this end we estimate terms (iv), (v) and (vi) one by one. 


(iv) By the definitions E,^ and E”, we have 


E^ [y„+i] - E^ 1 [y„+i]= E k+1 (Xlx ^) - y„+i (x) 


It follows from Ito’s formula that 

rt. 








(3.53) 


y„+i(A‘:;"J = y„+i(x) + ^‘'‘^' (5^(x^--)y^^,(A^-“) + ^F"+i(X‘">-))ds 

+ ^’‘^V,y^+i(A‘-")dIF«. (3.54) 

Taking conditional expectation E to Equations (13.5311 and (I3.54p , we obtain 

V tn. 


= -E 

ES[y„+i]-ErM>;.+i] = E 

= E 






6„«"'")K+i(A':-^)+ 


tn,X\ I i^tn) x^// 




■ At + Rn, 
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where 




+E 


:= E 


I'^tn 


^n+i (rr )‘^ 


-E [6„«-")y^+i + ^^F"+i«-")] • At. 


As a consequence 


’' ^Ti + l,; 

in 


■')]-At-lr?) 


■At- 
(3.55) 


Similarly 

(' [^n],E: [F„+i] -E^ 1 [y„+i]) 

= (E[6„(X‘:>")y^+i(A‘:’") + ^^i;:V,(A‘:'")] .At + i?„)dcr. 

Adding p.55l) to (13.561) we have that 

(iv)= ( - /'E[y„+i(A‘:;"j]E[-6„(^::+^-)i^;(^::+^-)]dx 

»-' M 


dx. 


(3.56) 


(iv-l) 


+ [ E[i^„(^*:+^-)jE[64x‘:’")i;:+i«"’")]dx )-At 

jR ■- J / 


(-J 

f E 

R 

(iv 

Yn+liXl-^) 

-2) 

2 (3-57) 

[ E 
Jr 

fni^'c^'n 

(iv-3) 


(iv-4) 


i?^= / E[y„+i(A‘:fj]i^„dx+ [ E[^„(^*:+^-)]i?„dx. 

Jr Jr 


where 
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Again by using the Ito formula we obtain 


in 

)di?„ 


^n + 1 




= bn{x)+J^ + 

+ j'^^\sbU^l-+^--)diVs. 

Hence, the term E[6„(^^+''*)^^^‘;;+''*)] on the right hand side of p.57l) can be 
written as E[6„(^*"+^'*)K;,(^*"+^'")] = b„ix)f'^( x) + Pnix) with 


P„(x)=e[6„(x)-+ 

+ y^Ux) • ))ds 


As a result the terms on the right hand side of (13.571) can be rewritten as 


(iv-l)= f {Yr,+i{x)-bn{x)'^'^{x))dx + H^, 

Jr 

(3.58) 

(iv-2)= [ (^n{x)bn{x)Y^^^{x))dx + Hl, 

Jr 

(3.59) 

(iv-3) = - / l^y„+i(x)^"(x)dx + p3, 

v/E ^ 

(3.60) 

(iv 4) = / *- ^„(x)r"_,.i(x)dx + P^, 

JE ^ 

(3.61) 
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where 

H}.= 


Hl = 


Ht = - 


1= f {(y„+i(a;)+E[ f {bs{Xl-nY;+AXl-n+^-^Y:+,{Xl-n)ds)]) ■P„(a;) 

tn 

^ tn 

f {r„+i (x) • ^^E[ (- 6,)T^i3) ^ 

»/ IR d tji 

/•*n + l 'l2 




Integrating by parts, we obtain 

[ {Y^+i{x)-bn{x)^'^{x))dx = - /'y^+i(x) 6 „(x)i^„(x)da 

Js. JR 


- / Yn+i{x)b'^{xYnix)dx, 

Jr 

( 3 . 62 ) 

2 ^n+lixY n{x)dx, 

( 3 . 63 ) 

[ 2 ^nix)Y„+i{x)dx. 

'jR 

( 3 . 64 ) 


Adding (13.581) to (13.591) and applying p.62l) . the sum of the first two terms on the right 
hand side of (13.57^ becomes 

- /E[y„+i«";"J]E[-6„(^*r^’^)i^;(^t+^-)]dx 
Jr 

+ [ E[i^„(^J:+^-)]E[6„(X‘:’“)y,^+i(X‘:’“)]da; (3.65) 

Jr 

= - [ Yn-\-i{x)b'^{x)'^n{x)dx-\-H^-\-H^. 

Jr 

Similarly, adding (I3.60p to (13.611) and applying (13.641) . (13.641) yields 

- [ E[y„+i(x‘:;"j]E[i^4^"(^‘:+^-)]dx+ [ E[f4Yc^nH^^Y:+,{xi:’^)]dx 

Jr ^ Jr ^ 
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which is the sum of the last two terms on the right hand side of (13.5711 . 

For first two terms on the right hand side of equation (13.5211 . we insert (j3.65|l and 
(|3.66ll into (13.5711 to obtain the following equation 

r (3-67) 

= (— / Yn+i{x)b'j^{x)Y n{x)dx)At+{H^ + H'^ + H!^ + H^)At + R^. 

Jr 


Next, we consider the term 

in (13.5211 . From the definition of E" and one has 

(E-[/r„+iy„+i],fe-[^„])Ayt„-(fer'['^n^n],ErM^n+i])Ayt„ 

= / E[h{XlX)Y^+,{XlX)^^{x)] -E[/r(^*:+^’")f „(^*:+-")y„+i(a;)]dxAyt„. 

Jr 


We apply ltd formula to h on time interval [tnjtn+i] to get 

h{XlX)=h{x)+ + 


(3.68) 


7 ‘ 

Ju. 


a,h'{X*r^)dWs, 


and 


rt-n + l , , 

+ / a,h'{Xl-+^’-)dWs. 


Thus 


E[h(A‘:;"^ )r„+i iX*:P^n (x)] 

= h{x)Y^+l {x)^n ix) + f „ (cc) • E [ {h{Xl:i^^ ) - h{x))Yr,+ i (x) 

+ h{x) (r„+i ) - y„+i (x)) + (h(A*:;^) - h{x)) (r„+i ) - y„+i (x))] 


= /i(x)i^„(x)F„+i (x) + y„+i (x) • E [- h{x)) i^„(x) 

With the above equations, (13.6811 becomes 

(e- [/i„+iy„+i], 1 e : y „]) Ayt„ - (t y 1 [t „] ,Ey 1 [y„+i]) Ayt„ = g), Ayt„ , 

(3.69) 
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where 

Gl,= [ {fn{x)-E[{h{XlX)-h{x))Y^+i{x) 

JR 

-Yr,+Jx)-E[{h{^l:+^’^)-hix))^n{x) 

+ h{x){fni1^ll+^’^)-^r,ix))+{h{1cll+^’^)-hix)){fr,i^ll-^^'^)-^n{x))]}dx. 
Finally, we consider the term 

on the right hand side of equation (|3.52p . From the relation between Zt and given 
in (1^ . we know that 


rz f\rtn,X\ ' '' ^'ri-\-l ' sjrtn^X \ — \ 

Z„+i(Aj^^J- (VAt^^J at„ 


tn + 1/ + l 


and 






Therefore we have 


E!! 




],t"[i^„]\ = e[ f ^Zr.+,{xlX)-^4x)d. 

y^Ptn+i ■ rn(a;) • da; 


(3.70) 


and 


-+i[:^l„],E^+i[F„+i]\ = Ef [ ^^„(^‘;:+^’")-y„+i(a;)da 

/ '-Jr (Tt„ 


= E 


f ^ ■y„+i(a;)-(V^*;;+^-")-^da; 

7r 


Adding (|3.70p and f|3.7ip together, we obtain 




0't„ 


= E 
where 
Gl=E 


Pt „+1 (a;) • 7„ (a;)dx + (a;) • Y^+i [x)dx 


(3.71) 


(3.72) 


+ G^ 


(A‘;;“ ) • 7„ (a;) • (VA*;;^) ^dx-J^ Pt^^, (a;) ■ 7 1 „ (a;)da; 


+ E 


^Pt„^(^t^’"))•>;^+l(a;)•(V^::+-")-lda;-^Pt„^,^(a;)•y„+l(a;)dx 


57, 
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Integrating by parts gives, 

[ Pt„+i ix)-^„{x)dx = - f pt^^^^^-^ix)-Yn+i{x)dx. 

Jr Jr 

Therefore 

Gl = [^n]^ AV^„ + [^^„],E-+i[rn+i]y (3.73) 

From (13.671) . (13.691) and (13.731) . equation (13.521) becomes 

(ES[r„],ts[?„])-(Eri[y„+i],tri[^n+i]) 

= (- [ Yr,+i{x)b'„{x)'^n{x)dx) At+ {H^+ H^ + H;^ + H^)At + 

dR (3.74) 

+ [ E[&;(^‘;:+^’")F^„(^‘;;+^’")]y„+i(x)dxAt+G„AFi„ 

Jr 

=HnAt + + Gn AVt„ + FnAt, 

where 

Hn = H^ + H^ + H!^ + H^, G„ = G)j + G^ 

and 

Fr,= ( r„+i(x)(E[6;(:^‘:+-")i^„(^::+^-")]-6;(x)i^„(x))dx. 

«/IR 

Next, we sum (13.741) from n = 0 to n = iV — 1 to get 

(eo [yp], fes [^o]) - ( , Ef [y^,]) 

^-1 (3.75) 

= {HnAt + R^ + G„AVt„ +y„At). 

n—0 

From definitions of Hn , R^, Gn and Fn, it’s easy to verify that i?[(i7„)^] < G(At)^, 
EHR^)"^] < C{At)^,E[{Gnf] < C{Atf and E[{Fr,f] < G{At). Therefore, 

N-l 

lim y (i7„At + i7“+G„Ayt„+y„At) = 0, a.s.. 

n=0 


Also, since limAt^o ^^3 = and limAt-s-o A/v = ^t; we have 

(y„y) = (yt,y) 


as required. □ 


Now are ready to state the main result in this paper. It is a direct consequence of 
Theorems 13.21 and 13.51 

Theorem 3.6 Assume that the ssumptions in Theorem \3.'A and Theorem \3.5\ hold. 
Then 

'YT,(l})=E[<i>{UT)QT\E^], V(^g£°°(R‘'). 
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Proof. Applying Theorem 13.51 one has 




Since YT = (j) as given in (13.91) , ^o 
as proved in Theorem 13.2[ we have 


0 = po given in 


in (I3.46P and Yq = Ex [(/)(5't)Qt|-^t ] 



\x. 


Let be any bounded measurable random variable, 



It then follows from the fact that ), and definition of P 


E[(^ T,(l)^<f]=E[(t){UT)QTp\, 


as required in the theorem. □ 


Remark. From (12.41) . we can see that 





for the optimal filter problem. 

4 Closing Remarks 

In this paper, we derived a Feymann-Kac type BDSDE formula for optimal filter prob¬ 
lems and its adjoint. Then we show that the adjoint provides a unnormalized solution 
for the optimal filter problem (BSDE filter). As our preliminary work has shown, the 
BSDE filter has the potential to solve the optimal filter problem with more accuracy 
and less complexity than traditional filter methods. 
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